A New Learning Algorithm for Single hidden Layer Feedforward Neural Networks
نویسندگان
چکیده
For high dimensional pattern recognition problems, the learning speed of gradient based training algorithms (back-propagation) is generally very slow. Local minimum, improper learning rate and over-fitting are some of the other issues. Extreme learning machine was proposed as a non-iterative learning algorithm for single-hidden layer feed forward neural network (SLFN) to overcome these issues. The input weight and biases are chosen randomly in ELM which makes the classification system of nondeterministic behavior. In this paper, a new learning algorithm is presented in which the input weights and the hidden layer biases of SLFN are assigned from basis vectors generated by training space. The output weights and biases are decided through simple generalized inverse operation on output matrix of hidden layer. This makes very fast learning speed and better generalization performance in comparison to conventional learning algorithm as well as ELM. General Terms Artificial Neural Network, Pattern Recognition
منابع مشابه
Extreme learning machine: Theory and applications
It is clear that the learning speed of feedforward neural networks is in general far slower than required and it has been a major bottleneck in their applications for past decades. Two key reasons behind may be: (1) the slow gradient-based learning algorithms are extensively used to train neural networks, and (2) all the parameters of the networks are tuned iteratively by using such learning al...
متن کاملRapid and brief communication Evolutionary extreme learningmachine
Extreme learning machine (ELM) [G.-B. Huang, Q.-Y. Zhu, C.-K. Siew, Extreme learning machine: a new learning scheme of feedforward neural networks, in: Proceedings of the International Joint Conference on Neural Networks (IJCNN2004), Budapest, Hungary, 25–29 July 2004], a novel learning algorithm much faster than the traditional gradient-based learning algorithms, was proposed recently for sing...
متن کاملFirst-Order Optimization Method for Single and Multiple-Layer Feedforward Artificial Neural Networks
In this study, we apply the first-order optimization method in single and multiple-layer feedforward artificial neural networking problem and obtained some useful results. Trial and error basis has been applied in determining the internal parameters of the network considered as having a significant influence over its performance: the number of hidden layers, activation function, number of neuro...
متن کاملExtreme Learning Machine with Randomly Assigned RBF Kernels
A new learning algorithm called extreme learning machine (ELM) has recently been proposed for single-hidden layer feedforward neural networks (SLFNs) with additive neurons to easily achieve good generalization performance at extremely fast learning speed. ELM randomly chooses the input weights and analytically determines the output weights of SLFNs. It is proved in theory that ELM can be extend...
متن کاملExtreme Learning Machine
Slow speed of feedforward neural networks has been hampering their growth for past decades. Unlike traditional algorithms extreme learning machine (ELM) [5][6] for single hidden layer feedforward network (SLFN) chooses input weight and hidden biases randomly and determines the output weight through linear algebraic manipulations. We propose ELM as an auto associative neural network (AANN) and i...
متن کامل